Exploration histories and future potential: overview

Neuromodulation and neurostimulation: overview and future potential

Digital Histories for Future Health

In this paper we describe the opportunity for digital behavioral histories to empower individuals to engage in positive health behaviors. The digital trails we leave by using various social, mobile and web services and self-tracking tools can be used to create a compelling digital narrative of past behaviors. The use of these digital narratives should be explored for the purpose of facilitating...

Exploration Potential

We introduce exploration potential, a quantity for that measures how much a reinforcement learning agent has explored its environment class. In contrast to information gain, exploration potential takes the problem’s reward structure into account. This leads to an exploration criterion that is both necessary and sufficient for asymptotic optimality (learning to act optimally across the entire en...

Workshop Overview and Future Directions

On February 7–9, 2003, approximately 60 scientists gathered at the Lunar and Planetary Institute in Houston, Texas, for a workshop devoted to improving knowledge of the impact cratering process. We (co-conveners Elisabetta Pierazzo and Robert Herrick) both focus research efforts on studying the impact cratering process, but the former specializes in numerical modeling while the latter draws inf...

Towards the Exploration Strategies by Mining Mylyns’ Interaction Histories

When developers perform a maintenance task, they always explore the program, i.e., move from one program entity to another. However, even though maintenance is a crucial task, the exploration strategies (ES) used by developers to navigate through the program entities remain unstudied. This lack of study prevents us from understanding how developers explore a program and perform a change task, f...